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ABSTRACT 

I 

A constrained  generalized  network  problem  is  a linear  programming 
problem  in  which  the  coefficient  matrix  contains  m + q rows  which  are 
ordered  such  that  each  column  has  at  most  two  non-zero  entries  in  the 
first  m rows.  This  paper  describes  highly  efficient  ways  to  modify  and 


implement  the  steps  of  the  simplex  algorithm  for  such  problems.  The 
efficiency  is  the  direct  result  of  exploiting  the  generalized  network 
portion  (first  m rows)  of  the  coefficient  matrix. 


1 . 0 INTRODUCTION 

A constrained  generalized  network  problem  is  a capacitated  or  uncapa- 
citated linear  programming  (LP)  problem  in  which  the  coefficient  matrix 
contains  m + q rows  which  are  ordered  such  that  each  column  has  at  most 
two  non-zero  entries  in  the  first  m rows.  Note  that  by  appropriately 
assigning  values  of  m and  q,  any  LP  problem  is  a constrained  generalized 
network  problem.  A major  portion  of  the  LP  literature  has  been  devoted 
either  to  problems  in  which  m = 0 (standard  LP  problems)  or  to  problems 
in  which  q = 0 (network  related  problems) . The  advantages  of  working 
with  LP  problems  where  m = 0 have  been  dramatically  shown  in  the  litera- 
ture [2,7,8,17,21,24].  However,  with  the  exception  of  generalized  upper 
bounding  (GUB)  procedures,  little  research  has  been  devoted  to  problems 
which  are  combinations  of  networks  and  standard  LP  problems. 

This  paper  describes  highly  efficient  ways  to  modify  and  implement 
the  steps  of  the  simplex  algorithm  for  such  problems.  The  efficiency  is 
the  direct  result  of  exploiting  the  generalized  network  portion  (first  m 
rows)  of  the  coefficient  matrix.  Thus,  this  research  can  be  viewed  as 
extending  the  concepts  of  exploiting  special  structure  in  LP  problems, 
such  as  those  presented  in  GUB  procedures  and  in  partitioning  methods 
[3,4,18,22].  As  stated,  the  term  generalized  network  (GN)  will  be  used 
to  define  the  special  structure  evident  in  the  constrained  generalized 
network  (CGN)  problem.  Any  GN  problem  is  characterized  by  a coefficient 
matrix  which  has  at  most  two  non-zero  entries  in  each  column.  The  term 
GN,  therefore,  is  actually  the  broadest  classification  of  network  related 
problems.  Depending  upon  the  non-zero  components  of  the  coefficient  matrix. 


* 
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a C.N  problem  could  be  a shortest  path  problem,  an  assignment  problem,  a 
transportation  problem,  a transshipment  problem,  a generalized  transporta- 
tion problem,  a generalized  transshipment  problem,  or  even  simple  GUB  * 

constraints.  The  procedures  presented  subsequently  are  general  enough  to 
handle  any  of  the  network  related  problems  listed  above.  To  this  extent, 
a higher  degree  of  efficiency  may  be  achieved  in  certain  cases  [9,18]  by 
further  exploiting  the  structure  of  the  specific  GN  problem. 

Some  of  the  most  efficient  procedures  for  solving  GN  problems  are 
based  on  viewing  the  problems  in  a graphical  context.  In  particular, 
the  simplex  algorithm  has  been  adapted  [2,6,7,12,13,14,19,23]  to  solve 
problems  in  which  the  coefficient  matrix  and  the  basis  matrix  are  stored 
as  graphs  using  computer  list  structures.  The  use  of  such  structures 
reduces  both  the  amount  of  work  needed  to  perform  the  fundamental  simplex 
operations  and  the  amount  of  computer  memory  required  to  store  essential 
data . 

Due  to  the  near-triangularity  of  bases  for  GN  problems,  the  matrix 
operations  of  finding  the  representation  of  an  entering  vector  and  deter- 
mining updated  pseudo  dual  variable  values  can  be  performed  by  tracing 
paths  within  the  basis  graphs.  Therefore,  no  explicit  basis  matrix  is 
needed  and  the  usual  arithmetic  operations  required  to  update  the  inverse 
(and  possible  round-off  error)  are  eliminated.  In  addition,  the  graphs 
contain  only  the  non-zero  matrix  components  which  allows  the  list  procedures 
[6,12,14]  to  eliminate  checking  and  performing  unnecessary  arithmetic  opera- 
tions on  zero  elements.  The  advantages  of  using  such  techniques  are  illus- 
trated by  the  fact  that  simplex  codes  for  solving  capacicated  transshipment 
problems  which  employ  graph  processing  techniques  [7,17]  are  at  least  75 
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times  faster  than  state  of  the  art  commercial  LP  codes.  In  fact,  a graph 
processing  code  for  solving  transportation  problems  [8|  has  been  shown  to 
he  1 '>0  times  faster  than  the  OPHKLIK  1,1’  code. 

The  graph  processing  techniques  also  have  the  added  advantage  of  re- 
quiring less  computer  memory  to  solve  a problem.  This  allows  larger  pro- 
blems to  be  solved  without  resorting  to  slower  external  storage.  Even  if 
the  use  of  external  storage  is  unavoidable,  the  graph  procedures  are  nor- 
mally able  to  maintain  all  basis  information  in  central  memory  and  are 
able  to  facilitate  efficient  input/output  processing  of  nonbasic  variable 
data. 

Motiva  ,;d  by  these  advantages,  this  paper  presents  efficient  procedures 
for  solving  constrained  generalized  network  problems.  A partitioning  method 
is  employed  in  conjunction  with  the  simplex  algorithm.  In  particular,  the 
working  basis  for  the  CGN  problem  is  partitioned  in  such  a way  that  the 
near-triangularity  of  those  portions  relating  to  the  GN  problem  can  be 
fully  exploited  from  both  algebraic  and  graph  processing  viewpoints. 

These  solution  procedures  can  be  easily  applied  to  GN  problems  to 
which  extra  constraints  have  been  added.  Such  problems  include  multi- 
commodity  inventory  scheduling  problems,  block  diagonal  GN  problems  with 
coupling  constraints,  and  goal  programming  GN  problems.  However,  one  of 
the  major  objectives  of  this  research  is  to  draw  attention  to  the  critical 
nature  of  the  formulation  process.  Every  LP  problem  is  a CGN  problem, 
but  the  efficiency  of  the  solution  procedures  depends  on  maximizing  the 
size  of  the  GN  portion  of  the  problem.  In  this  regard,  future  research 
is  needed  to  explore  formulation  and  transformation  procedures. 
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2.0  PROBLEM  DEFINITION 

The  constrained  generalized  network  (CGN)  problem  and  its  dual  may  be 
stated  mathematically  as  follows: 

Primal 
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subject  to: 
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where  G is  (m  x n) , A 

1 is 

(q  x n) , 

and 

is  (q  x k)  . 

The 

vectors  are  conformable  column  vectors. 

Each  column  of  the  matrix  G contains  at  most  two  non-zero  entries 
which  makes  it  possible  to  streamline  the  basic  steps  of  the  simplex 
algorithm.  Any  LP  problem  containing  a coefficient  matrix  with  this  struc- 
ture lies  in  the  domain  of  the  broad  classification  referred  to  in  the 
Literature  as  generalized  network  (GN)  problems  [1,10,12].  For  this 
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reason,  the  (2)  portion  of  the  CGN  problem  will  be  referred  to  as  the 
underlying  GN  problem.  The  procedures  presented  in  this  paper,  as  is  true 
with  much  of  the  literature  on  GN  problems  [1,3,4,12,13,19,20],  are  based 
on  visualizing  and  storing  the  information  associated  with  G as  a graph. 
Thus  the  essential  concepts  and  definitions  of  elementary  graph  theory 
will  be  presented. 

A simple  graph  G(V,E)  is  a finite  set  of  vertices  V and  a finite  set 
of  edges  E connecting  the  vertices.  Each  element  of  E is  identified  with 
an  unordered  pair  of  distinct  elements  of  V.  Visually,  each  edge  connects 
two  distinct  vertices,  which  are  then  considered  to  be  adjacent.  If  the 
edge  set  E is  expanded  to  contain  edges  which  have  both  endpoints  incident 
on  the  same  vertex  (loops)  or  multiple  edges  connecting  the  same  two  ver- 
tices (parallel  edges),  then  G(V,E)  is  called  a general  graph  [5]. 

The  underlying  GN  problem  defines  a general  graph  as  follows.  Each 
row  of  G corresponds  to  a vertex  and  each  column  corresponds  to  an  edge 
of  the  general  graph.  The  non-zero  entries  in  a column  will  be  referred 
to  as  the  "multipliers"  associated  with  the  corresponding  edge.  The  posi- 
tions of  the  multipliers  denote  the  vertices  on  which  the  edge  is  incident. 
If  a column  has  only  one  multiplier,  then  the  endpoints  of  the  edge  are 
incident  on  the  same  vertex  and  the  edge  will  be  called  a loop.  Associated 
with  each  edge  is  a variable,  an  upper  bound,  an  objective  function  coeffi- 
cient, and  the  non-zero  multipliers.  Each  vertex  has  an  associated  right 
hand  side  component,  called  a vertex  value.  The  edge  multipliers  govern 
how  much  of  the  variables  are  to  be  added  to  (or  subtracted  from)  the 
appropriate  vertex  values. 
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It  is  customary  in  the  literature  on  GN  problems  to  assume  that  each 
edge  of  the  general  graph  has  an  implied  direction.  In  such  cases,  the  graph 


is  called  a 


[,  the  vertices  are  called  nodes,  and  the  edges  are  called 


arcs . A variable  is  then  considered  to  be  a flow  across  an  arc  from  one 
node  to  another.  In  generalized  transportation  problems,  this  is  done  by 
assigning  certain  vertices  to  be  sources  and  all  others  to  be  destinations 
and  scaling  the  multipliers  of  the  source  nodes  to  all  be  1.  If  the  problem 
is  a generalized  transshipment  network,  the  coefficient  matrix  is  trans- 
formed so  that  one  of  the  multipliers  on  an  edge  is  a -1  and  the  other  is 
some  non-zero  quantity.  The  edge  is  then  an  arc  directed  from  the  -1  co- 
efficient to  the  other.  In  certain  cases  the  digraph  formulation  can  be 
quite  efficient  since  it  reduces  both  the  amount  of  data  stored  and  the  com- 
plexity of  arithmetic  operations.  This  is  especially  true  if  G does  not  have 
full  row  rank,  since  any  GN  problem  with  less  than  full  row  rank  is  equiva- 
lent to  a disjoint  set  of  minimum  cost  flow  networks  [10] . However,  for  the 
sake  of  generality  the  subsequent  procedures  do  not  assume  that  the  under- 
lying GN  characterizes  a digraph. 


3.0  BASIS  STRUCTURE 

Using  the  standard  bounded  variable  simplex  algorithm,  a basis  B for 

the  CGN  problem  will  be  a matrix  composed  of  a linearly  independent  set  of 

G 0 

column  vectors  selected  from  the  coefficient  matrix  A = . The 

A1  A2  j 

variables  associated  with  the  column  vectors  of  B are  considered  to  be  basic 
variables  and  all  others  are  non-basic  variables  at  their  lower  or  upper 


bound . 
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For  convenience,  it  will  be  assumed  that  the  coefficient  matrix  A has 
full  row  rank.  If  this  is  not  the  case,  artificial  variables  may  be  appended 
to  the  problem.  Any  basis  B for  the  CGN  problem  will,  therefore,  be  a non- 
singular matrix  of  order  (m  + q)  x (m  + q) . Clearly,  any  basis  matrix  B 
may  be  partitioned  as  follows: 

(11) 


The  subscripts  are  used  to  denote  the  number  of  columns  in  each  matrix. 

G is  a non-singular  (m  x m)  matrix  which  is  composed  of  column  vectors 
m 

taken  from  G.  is  (m  x q)  and  may  contain  zero  vectors  and  vectors  from 

G.  A^,  which  is  (q  x m) , and  A^ , which  is  (q  x q) , are  the  continuations 
of  the  vectors  in  G^  and  , respectively.  Based  on  the  partitioning  of 
matrices  (11),  the  basis  matrix  inverse  B ^ may  be  stated  as  follows: 


G1+G1EQ1AG1 
m m q mm 

-Q_1A  G_l 
m m 


-G  1E  Q-1 

m q 

,-l 


(12) 


where  Q = A - A G ^E  . 

q m m q 

The  motivation  for  the  partitioning  of  (11)  is  to  factor  out  the  matrix 
G^,  which  must  by  definition  be  a basis  for  the  underlying  GN  problem.  As 
noted  earlier,  a basis  for  a GN  problem  may  be  viewed  and  stored  as  a general 
graph  which  contains  only  the  nonzero  components  of  the  basis  matrix.  Due 
to  the  near-triangularity  of  G^,  any  operations  involving  G ^ may  be  performed 
by  traversing  the  associated  general  graph.  This  fact  implies  that  the  only 
information  required  to  generate  the  basis  inverse  for  the  CGN  problem,  as 
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stated  in  (12),  is  the  partitioned  basis  B and  the  (q  x q)  non-singular 
matrix  Q \ As  a result,  the  simplex  operations  for  solving  the  CGN  problem 
can  be  streamlined  to  improve  computational  efficiency  and  computer  storage. 
Each  of  these  operations  will  be  described  in  detail  in  the  subsequent  sec- 
tion. However,  before  proceeding,  it  will  be  helpful  to  further  explore  the 

structure  of  G . 

m 

The  characteristics  of  the  general  graph  corresponding  to  G have  been 

m 

outlined  in  the  literature  [12,19,20].  It  contains  all  of  the  vertices  but 
only  a subset  of  the  edges  of  the  original  general  graph  corresponding  to  G. 
For  this  reason,  it  is  called  a spanning  subgraph.  Due  to  the  non-singularity 
of  G^,  the  spanning  subgraph  is  composed  of  a finite  set  of  disjoint  quasi- 
trees [12].  Each  quasi-tree  is  a simple  tree  to  which  a single  edge  has  been 
added.  The  additional  edge  generates  exactly  one  cycle  (a  circular  path)  in 
the  quasi-tree.  Note  that  a loop  (as  defined  previously)  is  a cycle  con- 
taining a single  vertex  and  a single  edge. 

Several  computer  list  structures  have  been  developed  for  storing  the 
basis  general  graphs  for  GN  problems  and  for  implementing  the  associated 
arithmetic  operations.  A thorough  knowledge  of  these  structures  and  pro- 
cedures is  not  a necessary  prerequisite  for  understanding  the  operations 
developed  subsequently.  However,  a general  insight  into  such  methodologies 
will  be  an  aid  to  realizing  the  implied  efficiency  involved.  A typical 
graph  processing  technique  is  the  extended  augmented  predecessor  index  (EAPI) 
method  [12].  This  method  is  based  on  the  triple-label  procedures  proposed 
by  Johnson  [15,16].  The  EAPI  method  orients  each  quasi-tree  so  that  the  cycle 
is  located  at  the  top  (a  rooted  cycle) . Any  subtrees  incident  on  cycle 
vertices  hang  down  from  this  rooted  cycle.  Associated  with  each  cycle  is 
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a cycle  factor  [11,12].  The  cycle  factor  is  used  to  facilitate  solving  the 
normally  non-triangular  square  system  of  equations  that  the  cycle  represents. 

One  of  the  advantages  of  the  EAPI  method  is  its  ability  to  perform 
operations  that  normally  require  a basis  inverse  by  traversing  the  quasi- 
trees of  the  basis  general  graph.  There  are  actually  two  types  of  quasi- 
tree traversal  required,  one  normally  associated  with  pre-multiplication  by 
the  inverse  and  the  other  normally  associated  with  post-multiplication  by 
the  inverse.  Pre-multiplication  is  generally  used  to  find  the  representation 
of  a column  vector (edge)  to  enter  the  basis.  The  EAPI  method  performs  this 
operation  by  tracing  the  unique  paths  from  the  vertices  on  which  the  edge 
is  incident  "up"  to  the  associated  cycle(s).  The  cycle  portion(s)  of  the 
representation  can  be  obtained  by  solving  a one  variable  equation  and  then 
tracing  a directed  path  once  around  the  cycle(s)  from  the  appropriate  vertex 
back  to  itself.  The  efficiency  of  this  operation  derives  from  '.he  fact  that 
at  most  two  quasi-trees  are  traversed  and  only  the  non-zero  components  of 
the  representation  are  generated.  Post-multiplication  by  the  basis  inverse 
is  normally  used  to  calculate  the  values  of  the  pseudo  dual  variables . The 
EAPI  method  associates  each  dual  variable  with  a vertex  of  the  basis  general 
graph.  A dual  variable  associated  with  a cycle  vertex  of  each  quasi-tree 
may  be  determined  by  solving  a one  variable  equation  using  the  cycle  factors 
[11,12].  The  remaining  dual  variables  can  be  determined  by  exploiting  the 
triangularity  of  the  resultant  systems  of  equations  and  by  locating  all 
vertices  lying  "below"  the  selected  cycle  vertices  in  the  quasi-trees.  This 
process  is  often  referred  to  as  "pricing-out"  the  basis  general  graph. 

The  subsequent  procedures  assume  that  is  stored  as  a general  graph. 
Each  operation  will  be  described  both  in  algebraic  terms  and  in  terms  of  the 
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two  types  of  quasi-tree  traversal  described  above.  It  will  be  assumed  that 
the  matrix  Q ^ of  (12)  is  available  in  some  form  after  each  basis  exchange 
step.  Other  portions  of  B ^ will  be  generated  only  as  they  are  needed.  The 
result  is  a highly  efficient  simplex  method  that  keeps  storage  requirements 
to  a minimum. 


4 . 0 ALGORITHMIC  STEPS 

This  section  describes  in  detail  the  basic  simplex  operations  as  they 
pertain  to  the  CGN  problem.  These  operations  include  initialization,  checking 
for  optimality,  finding  the  representation  of  the  vector  entering  the  basis, 
the  basis  exchange  step,  and  calculating  updated  pseudo  dual  variable  values. 
As  noted  in  section  3,  it  will  be  assumed  that  the  basis  is  partitioned  as 
in  (11),  that  G^  is  stored  as  a general  graph,  and  that  Q ^ is  the  only 
portion  of  the  basis  inverse  that  is  being  kept. 

4.1  Initialization 

An  initial  basis  B for  the  CGN  problem  can  be  obtained  by  selecting  a 
basis  G (perhaps  optimal)  for  the  underlying  GN  problem.  The  matrices  E 

m q 

and  A^  can  be  obtained  by  appending  q slack  or  artificial  variables  to  the 
problem  that  result  in  satisfying  the  constraints  (3).  Since  = 0,  Q from 


(12)  is  equal  to  A^  and,  hence, Q 


-1 


-1 


Once  a basis  has  been  selected,  the  complementary  slackness  conditions 
can  be  used  to  obtain  initial  pseudo  dual  variable  values  which  satisfy: 

T T \ 


(w  ,6  ) / 


4 E > . 
m q J 

, A 

V' 


(13) 


A A / 
m q / 


T T 

where  ( cm,  c^  is  an  appropriately  ordered  vector  of  objective  function 
coefficients  corresponding  to  B.  In  expanded  form,  (13)  becomes: 
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...  -r 

w c;  + 6 A 
m m 


w h + 6 A 


(14) 

(15) 


liquations  (14)  and  (15)  may  be  rewritten  as  follows: 

(16) 


T„  T xT» 

w G = c - 6 A 

mm  m 


T -1  T T -1 

6 (A  - AGE)  = c - c G E . 
q mmq  q mmq 

-1. 


(17) 


Noting  that  Q = A -AG  E , (17)  can  be  stated  as: 
q mmq 


T T T -1  -1 

6 = (c  - c G E ) Q . 

q mmq 


(18) 


Assuming  that  the  initial  basis  has  been  selected  as  described  above,  (18) 

T T -1 

implies  that  6 = c^Q 

6 could  be  recomputed  at  future  iterations  using  (18)  and  graph  opera- 
tions to  find  G . However,  as  q increases,  the  number  of  operations 
m q r 

involved  in  this  process  becomes  prohibitive.  Thus,  for  large  q,  it  is  better 
to  treat  6 as  an  extra  row  of  Q 1 and  update  it  at  each  iteration. 

Given  an  initial  value  of  6,  (16)  provides  an  excellent  framework  for 
the  calculation  of  w.  The  system  of  equations  of  (16)  is,  in  fact,  a series 
of  disjoint,  near-triangular  systems  of  equations.  Once  the  right  hand  side 
of  (16)  has  been  calculated,  the  "pricing-out"  procedure  discussed  in  section 
3 can  be  used  to  determine  the  value  of  w at  each  iteration. 

4 . 2 Determination  of  Optimality 

Let  P.  = P denote  any  column  vector  of  the  coefficient  matrix 

l m,  l 

P . 

q.i 


A,  where  P . is  associated  with  constraints  (2)  and  P . is  associated  with 
m, l q , l 

(3).  Optimality  of  both  the  primal  and  dual  solutions  occurs  when  the  pseudo 
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dual  solution  is  feasible.  A determination  of  this  can  be  made  by  first 
calculating  updated  objective  coefficients  associated  with  each  primal 
column  vector. 

Thus , 

t _T 

(19) 


- T T 

c.  = w P . + 6 P . - c. 

1 m, l q , l l 


Dual  feasibility  is  achieved  when  the  following  conditions  are  satisfied 
for  all  i: 


c.  < 0,  x.  = Oory.  = 0 

x x Jx 


c.  = 0,  x.  - basic  or  y . - basic  (20) 

x x x 


c.  > 0,  x.  = u or  y.  = v . 

x “ x x x i 


If  any  one  of  the  conditions  in  (20)  is  not  satisfied,  then  the  associated 
primal  column  vector  may  be  selected  to  enter  the  basis. 

4 . 3 Finding  the  Representation  of  the  Entering  Vector 


Let  P 


P denote  the  column  vector  selected  to  enter  the 

m,  r 


q.r 


basis  matrix.  The  representation  Z 


Z of  P in  terms  of  B must 

m,  r r 


q»r 


be  computed  so  that  the  vector  to  leave  the  basis  can  be  determined.  This 
computation  involves  solving  the  following  system  of  equations: 


Z = C,~LP  + G 1E  Q 1A  G_1P  - G_1E  Q 1P 
m,r  m m,r  m q mm  m,r  m q q,r 


Z = Q X(-A  G LP  + P ). 
q,r  mmm,r  q,r 


(21) 

(22) 


Substituting  Z into  (21)  yields 
q,r 


Z = G_1(P  - E Z ). 

m,r  m m, r q q , r 


(23) 


It  is  thus  efficient  to  first  calculate  Z and  then  to  use  this  result 

q.r 

to  find  Z . If  P =0  in  (22),  the  computation  of  Z reduces  to 
m, r m, r r q,r 

Z = Q *P  .If  not,  the  graph  traversal  method  described  in  section  3 
q > r q,r 

can  be  used  to  compute  G ^P  .As  noted,  this  is  the  representation  of 

m m,  r 

the  edge  P in  terms  of  the  basis  general  graph  G . The  EAPI  method  can 
m,r  ° ° r m 

perform  this  calculation  very  efficiently  and  will  only  find  the  non-zero 

components  of  the  representation.  Simultaneously,  appropriately  scaled 

columns  of  A can  be  accumulated  with  P . Upon  completion,  a multiplication 
m q,r 

by  Q can  be  performed  to  yield  Z . Using  this  method,  a ratio  test 

q>r 

should  be  performed  immediately  on  Z before  the  computation  of  Z is 

q,r 

made  since  degenerate  pivots  occur  frequently  in  network  problems  and,  there- 
fore, unnecessary  computations  could  be  avoided. 

The  computation  of  Z in  (23)  may  actually  be  performed  in  two 

m,  r 

different  ways,  depending  upon  the  particular  structure  of  the  problem 

being  solved.  If  q is  a relatively  small  number  or  if  E contains  a large 

number  of  zero  column  vectors,  then  (23)  should  be  rewritten  as  Z = 

m,  r 

G ^P  - G ^E  Z . G ^P  is  simply  the  representation  of  the  edge 
m m,r  m q q,r  m m,r  & 

associated  with  P^  ^ and  may  be  found  by  graph  traversal.  Likewise, 

G^E  is  a matrix  whose  column  vectors  are  the  representations  of  the  q 
edges  associated  with  the  columns  of  E . If  q is  small  or  if  the  number 

q 

of  actual  edges  is  small,  then  this  may  be  performed  very  efficiently  by 
the  graph  traversal  method  discussed  in  section  3. 


If,  however,  calculating  G^  E^  a column  at  a tim^-  is  too  lengthy,  then 

(23)  shall  be  restated  and  solved  in  the  form  GZ  =(P  -EZ  ). 

m m,r  m,r  q q,r 

In  this  form,  finding  Z^  ^ is  equivalent  to  determining  basic  variable 


values  in  a GN  problem  with  a right  hand  side  of  (P  - E Z ) . Again 

m,r  q q,r 
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due  to  the  near-triangularity  of  G , this  determination  can  be  easily 

m 

performed.  Simply  stated,  this  involves  assigning  values  to  terminal 
edges  of  the  quasi-trees,  successively  working  up  toward  the  rooted  cycles. 
Values  associated  with  cycle  edges  can  then  be  calculated  using  the  appro- 
priate cycle  factors. 

4.4  The  Basis  Exchange  Step 


Let  P = P 


denote  the  vector  selected  to  leave  the  basis. 


For  notational  convenience,  it  will  be  assumed  that  P occupies  the  s 

position  in  B.  The  position  of  Pg  plays  an  important  role  in  determining 

how  the  basis  exchange  is  to  be  performed.  An  indiscriminate  pivot  may 

result  in  the  destruction  of  the  basis  partitioning. 

In  order  to  update  Q ^ and  6 during  a pivot,  it  is  necessary  to  find 

the  last  q entries  in  the  sth  row  of  B \ Let  R denote  this  vector. 

s 

If  s > m,  then  R is  simply  the  (s-m)t'1  row  of  Q However,  if  s < m, 
s 

t h 

then  the  s row  of  (-G  E Q ) must  be  determined.  This  can  be  efficiently 

m q 

achieved  by  first  determining  the  sC^  row  of  G \ The  poly-w  technique  of 

m 

Charnes  and  Cooper  [3]  can  easily  be  applied  to  the  basis  general  graph  to 

—.1.  th 

generate  the  desired  row  of  G . This  procedure  uses  the  s unit  vector 

m 

as  a pseudo  cost  vector  and  the  "pricing-out"  graph  traversal  method  des- 
cribed in  section  3.  The  resulting  dual  variable  values  are  the  appropriate 

entries  in  the  s^  row  of  G \ This  process  only  involves  traversing  a 

m 

single  quasi-tree,  since  all  other  costs  are  zero,  and  then  only  that  portion 

of  the  quasi-tree  lying  below  the  edge  associated  with  P (all  other  dual 

m,  s 

variables  will  be  zero).  As  these  entries  are  determined,  the  appropriately 


scaled  rows  of  E can  be  accumulated  in  a vector  T (this  vector  may  also 
q s 

be  used  in  subsequent  calculations) . Upon  completion,  T^  is  complemented 
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-1 


and  multiplied  times  Q to  yield  R . 


Once  R is  known,  consideration  must  be  given  to  the  problem  of  properly 


maintaining  the  basis  partitioning.  The  following  cases  describe  the  appro- 


priate basis  exchange  procedures  based  on  the  position  of  P in  B. 

s 


Case  1:  The  minimum  ratio  occurred  in  Z (i.e..  s > m).  In 

q,r 


this  case  the  basis  exchange  may  be  performed  directly.  Neither  G nor 

m 


-1 


A will  be  affected  by  this  exchange.  Q and  6 may  be  updated  using 


l and  R . E and  A are  modified  by  the  insertion  of  P in  place  of 
q,r  s q q J r r 


P . 

s 


Case  2:  The  minimum  ratio  occurs  in  Z (i.e..  s < m) . This 

m,r 


case  actually  must  be  divided  into  two  subcases.  The  determining  factor  is 
whether  or  not  the  basis  exchange  will  result  in  a G that  is  a basis  for 


the  underlying  GN  problem.  This  can  be  checked  by  looking  at  the  repre- 

th 


sentation  of  P in  terms  of  G . If  the  s position  of  this  vector  if 
m,  r m r 

zero,  then  the  exchange  will  destroy  the  partitioning  B. 


Case  2(a):  The  sth  component  of  G ^P  is  zero.  If  the  basis 

m m,  r 


exchange  is  performed  directly,  the  resulting  G^  will  be  singular.  The 


following  remark  is  useful  in  resolving  this  issue. 


Remark:  If  the  sth  component  of  G ^P  is  zero,  there  must 

m m,  r 


exist  a basis  vector  Pt,  where  t denotes  the  position  of  P in  the  basis 


and  where  m < t £ m + q,  such  that  when  switched  with  P in  the  basis 

s 


results  in  a non-singular  G . This  vector  can  be  determined  by  assigning 


t to  be  the  position  of  any  non-zero  component  of  T . 


Proof:  T corresponds  to  the  sth  row  of  G_1E  . G 1E  contains 

s m q m q 


the  representations  of  the  q column  vectors  of  E in  terms  of  G . Using 

q m 


th 


elementary  linear  algebra,  it  is  known  that  the  s vector  of  G can  be 

m 


j 
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replaced  by  the  tth  vector  of  as  long  as  the  tth  component  of  is 

non-zero.  It  is  impossible  for  T to  be  a zero  vector  since  this  would 

imply  (via  (23))  that  the  s 11  component  of  Z is  zero.  This  result  would 

m,  r 

be  a contradiction  of  the  ratio  test. 

Once  t has  been  determined,  the  basis  must  be  reordered  by  switching 

Pt  and  Pg  in  B.  The  general  graph  G^  must  be  modified  by  removing  the 

edge  associated  with  P and  inserting  the  edge  associated  with  P 

m,s  m,t 

Q must  also  be  modified  by  setting  the  (t-m)t^  row  of  Q ^ equal  to  Rg. 

After  this  interchange,  the  actual  basis  exchange  of  P for  P , where  now 

r s 

s > m,  may  be  performed  as  in  case  1. 

Case  2(b):  The  s'"*1  component  of  G ^P  is  non-zero.  In  this 

m m,r 

case,  the  basis  exchange  may  be  performed  directly  since  the  resulting  G 

m 

will  be  non-singular.  The  basis  graph  can  be  modified  by  deleting  the  edge 

associated  with  P and  inserting  the  one  associated  with  P . Q ^ and 
m,s  ° m,r 

6 can  be  updated  by  a standard  pivot  using  R and  Z 

s q,r 

All  of  the  basis  exchange  operations  described  above  should  involve 
both  updating  the  variable  vectors  x and  y and  updating  the  partial  vector 
of  pseudo  dual  variables  6.  The  only  other  operation  needed  to  complete 
the  exchange  is  to  compute  the  vector  w.  This  can  be  done  using  (16)  and 
the  procedure  discussed  in  section  4.1.  Upon  completion,  the  new  pseudo 
dual  variables  would  be  checked  for  feasibility  as  in  section  4.2. 

4 . 3 Conclusion 

Many  of  the  advances  in  the  solution  of  LP  problems  in  recent  years 
have  been  the  result  of  exploiting  special  structures.  One  of  the  major 
areas  of  research  has  been  in  the  solution  of  network  related  problems. 

A few  of  the  reasons  for  this  interest  in  networks  are  that  they  are  easily 
visualized,  that  they  occur  frequently  in  real-world  applications,  and 


that  highly  efficient  techniques  are  being  developed  for  their  solution. 
This  paper  extends  the  usefulness  of  these  procedures  to  a much  broader 
class  of  problem. 


The  efficiency  evident  in  these  procedures  for  solving  constrained 
generalized  network  problems  draws  attention  to  the  importance  of  the 
formulation  process.  A large  number  of  problems  could  be  solved  using 
these  procedures,  if  they  are  properly  formulated  or  transformed.  To  this 
end,  future  research  is  needed  to  identify  general  classes  of  problems 
to  which  these  procedures  can  be  applied  and  to  explore  transformation 
procedures  that  maximize  the  efficiency  of  these  methods. 
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